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Abstract 

o 

■ A sensor network is used for distributed joint mean and variance estimation, in a single time snapshot. Sensors 

observe a signal embedded in noise, which are phase modulated using a constant-modulus scheme and transmitted 
over a Gaussian multiple-access channel to a fusion center, where the mean and variance are estimated jointly, 
using an asymptotically minimum-variance estimator, which is shown to decouple into simple individual estimators 
of the mean and the variance. The constant-modulus phase modulation scheme ensures a fixed transmit power, 
^| robust estimation across several sensing noise distributions, as well as an SNR estimate that requires a single set 

of transmissions from the sensors to the fusion center, unlike the amplify-and-forward approach. The performance 
of the estimators of the mean and variance are evaluated in terms of asymptotic variance, which is used to evaluate 
the performance of the SNR estimator in the case of Gaussian, Laplace and Cauchy sensing noise distributions. 
For each sensing noise distribution, the optimal phase transmission parameters are also determined. The asymptotic 
relative efficiency of the mean and variance estimators is evaluated. It is shown that among the noise distributions 
considered, the estimators are asymptotically efficient only when the noise distribution is Gaussian. Simulation 
results corroborate analytical results. 
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I. INTRODUCTION 



SNR estimation of a signal embedded in noise finds applications in diverse areas in signal processing 
and communications, such as signal strength estimation for cognitive radio, in diversity combining and 
• im ' in bit- synchronization applications. The SNR estimate can be obtained by combining the estimates of the 
^ mean and the variance. In addition to being used to form the SNR estimate, the variance can be used to 
c3 ! estimate the quality and the variability of the sensor measurements, since the quality of the estimates of 
the mean and variance in turn depend on the true value of the variance [HI, [121. 

In centralized estimation problems, the samples of the signals embedded in noise are directly available to 
the estimator fl3] — [IH1 - Centralized schemes for SNR estimation of signals embedded in Gaussian noise are 
considered in [[8l- [[T3l . In the case of non-Gaussian noise, the mean and variance are estimated separately, 
and then combined to form the SNR estimate, as discussed in fl3j — flVj . In (3l-[[6l, the mean and the 
variance are separately estimated from the characteristic function of the signal embedded in noise. 

In contrast to the centralized regime outlined above, in the case of distributed estimation, the observations 
are not directly available at the estimator, but have to be transmitted to a fusion center (FC) for estimation. 
In [fT4ll . [fT5l , the authors consider a digital transmission scheme where the sensors quantize their observa- 
tions and then transmit them to the FC. Analog transmissions can also be used between the sensors and the 
FC. The most commonly used type of analog transmission is the amplify-and-forward scheme, lfl6l . [flTl . 
where the instantaneous transmit power at the sensors depends on the individual sensing noise realizations, 
and can be arbitrarily high in the typical case where the sensing noise has infinite support. Furthermore, 
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Fig. 1. System model: Wireless sensor network with constant modulus transmissions from the sensors. 



with amplify-and-forward transmissions, the signal received at the FC approximates the sample mean of 
the sensor observations. Since with amplify-and-forward, a linear function of the sensed data is transmitted 
over additive Gaussian multiple-access channels, only information about the first moment is available at 
the FC. In order to estimate other (higher-order) moments with amplify-and-forward transmissions from 
the sensors to the FC, each sensor will have to transmit different powers of the data across multiple 
time snapshots, which is not desirable in delay and bandwidth sensitive applications. When estimation 
is attempted at the sensors before transmission [[131 . multiple observations are required to accumulate 
at the sensors before the estimation, making estimation in a single time snapshot difficult. In contrast, 
transmitting non-linear functions of the observation makes it possible to estimate second moments within 
a single time-slot, making such a scheme preferable for delay-sensitive applications |[T8l . lfT9l . 

In this paper, we consider the joint estimation of the mean and variance of a signal embedded in noise in 
a distributed fashion, for the first time in the literature. Sensors are exposed to a signal in (not necessarily 
Gaussian) noise as seen in Figure Q] The sensors phase modulate the observations using a constant-modulus 
scheme and transmit these signals to a fusion center (FC) over a Gaussian multiple-access channel ll20l 
pp. 378]. These analog transmissions are appropriately pulse-shaped to consume finite bandwidth. Similar 
to ETI . the constant-modulus nature of the transmissions ensures a fixed instantaneous transmit power at 
the sensors, irrespective of the sensing noise realizations. Due to the additive nature of the multiple-access 
channel, the signals transmitted from the sensors superimpose at the FC, and approximate the characteristic 
function of the sensed data. This enables robust estimation of not only the mean but also the variance, 
unlike ETI . These estimates of the mean and variance are used for constructing the SNR estimate, and 
therefore, the phase modulation scheme allows for the estimation of the mean, variance and SNR with a 
single set of transmissions from the sensors to the FC. The asymptotic relative efficiency of each of the 
estimators is calculated for different sensing noise distributions. It is shown that among the sensing noise 
distributions considered (Gaussian, Laplace and Cauchy), the estimators are asymptotically efficient only 
if the sensing noise distribution is Gaussian. In cases where the moments of the sensed data do not exist, 
the more general quantities, location parameter and scale parameter are defined and used. 

The rest of this paper is organized as follows. The system model is introduced in Section [n] In Section 
UTTl it is assumed that there is a fixed total power available across all sensors. Minimum-variance estimators 
for the mean and variance are presented, along with optimal values for the phase modulation parameter 
for different sensing noise distributions. In Section [V] the estimators are revisited assuming a fixed-power 
budget at each sensor. The asymptotic relative efficiency of each of the estimators is also found under this 
per-sensor power constraint in Section IIV-BI Simulation results are presented in Section |Vj and concluding 
remarks in Section |VI] 
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II. System Model 

A sensor network, illustrated in Figure [T] consisting of L sensors observe a deterministic parameter, 9, 
in noise. The value, x\, observed at the I th sensor is 

xi = 9 + arji (1) 

for I = 1, L, where 9 is a deterministic, real-valued, unknown parameter in a bounded interval, (0, 9r], 
of known length, 9 R < oo, and r/i are independent and identically distributed (iid) real-valued random 
variables drawn from a distribution symmetric about zero, and a > is a scale parameter, which is 
proportional to the standard deviation when the standard deviation of r/i exists. When the mean of r/i 
exists, E[xj\ = 9. Otherwise, we will refer to 9 as a location parameter of xi. The sensing SNR is defined 
as 7 := 9 2 /a 2 . Due to practical constraints on the peak transmit power, we consider a scheme where the 
I th sensor transmits its measurement, x\, using a constant modulus base-band equivalent signal, y/pe juJXl , 
with power p, over a Gaussian multiple-access channel so that the received signal at the fusion center is 
given by 

L 

i=i 

where u E (0, 2it/9r], is a design parameter to be optimized, and v ~ CJ\f(0, a 2 ) is the channel noise 
independent of {r]i}f =1 . Note that the restriction to E (0, 2h/9r] is necessary even in the absence of sensing 
and channel noise to uniquely determine 9 from y L . 

As seen in d2]), all sensors transmit using the same value of to. The transmissions are to be appropriately 
pulse-shaped and phase modulated to consume finite bandwidth. The transmission power at each sensor 
is the same and is given by p. Two cases of power constraint are considered in this paper. In the first 
case, a total power constraint, P, is considered, where p = P/L. Irrespective of the number of sensors in 
the system, the total transmit power from all the sensors in the system remains P. The other transmission 
scheme is a per-sensor power constraint, where p = P. In this regime, increasing the number of sensors 
increases the total transmit power, and as L — >■ oo, the channel noise becomes negligible compared to the 
transmit power. 



III. Total Power Constraint 

Under the total power constraint on the sensor transmissions, we derive asymptotically optimal estima- 
tors in this section. The asymptotic variance of the estimators are also derived, and the value of to that 
minimizes the asymptotic variance is computed. 

In the total power constraint regime, each sensor transmits with a power of p = P/L. The normalized 
signal at the FC that the estimator acts on is given by 

Asymptotically, as L — > oo, 

1 L 

z := lim z L = \fP lim — } t ju>Xl 

i=l 

= sfPe^ip^au), (4) 

with probability one, where ip v (aco) = E [e^ W(TVi ] is the characteristic function of r/j. The characteristic 
function of the sensing noise is real-valued, since the distribution of r]i is symmetric about the median. 
Also define zl\ = [z^ where z^ and z ! L are the real and imaginary parts of the random variable, 
zl, respectively. The vector converges for large L to z = [z R z 1 } 7 ', where z R = liniL_ i . 00 z^ = 
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Re{z} = yP cos(o;6 l )v9 ?? ((TCi;) and z 1 = Hindoo z£ = Im{^} = yP sm(u9)ip J1 (acj). Due to the central 
limit theorem, this convergence takes place in such a way that lim^oo vT(zl — z) is a 2 x 1 Gaussian 
random vector with zero mean and a 2 x 2 covariance matrix £ with elements 



Su = P [v c cos 2 (co9) + v s sm 2 (co9)] + \j 2 v 
S 22 = P [v s cos 2 (u9) + v c sm 2 (co9)] + \j 2 v 



S12 = E21 = P(v c — v s ) sm(u9) cos(u9), (5) 

where the parameters v c := var[cos(wr#)] = 1/2 + (p v (2au)/2 — (p 2 (au) and v s := var[sin(o;^)] = 1/2 — 
(p v (2auj)/2. 



A. The Asymptotically Minimum Variance Estimator 

From z L obtained at the FC, the values of 9 and a are estimated. The estimator for [9 a] T which yields 
the minimum variance is given by [1221 (3.6.2), pp. 82] 

T 



QOpt 



a 



opt 



argmm|Z£ 



zf] 



(6) 



where zl represents the normalized received data, and the right-hand-side of © depends on 9 and a 
through both £ and z. Intuitively, if the central limit theorem is invoked on zl in ©, the ML estimator of 
[9 a] T is the same as the estimator in ©. Interestingly, it is possible to express the asymptotic covariance 
of the estimator in ©, without having to express © in closed form. The asymptotic covariance of the 
asymptotically minimum variance estimator is given by [J T S1~ 1 J]~ 1 11221 Lemma 3.1], where J is the 
Jacobian matrix of z with respect to 9 and a and is given by 



— sm(u9)(p v (uia) 
cos(u)9)tp v (uj<j) 



cos(wt 
sin(w6 



da 



(7) 



After a straightforward calculation, the asymptotic covariance matrix is seen to be diagonal with the 
elements given by the asymptotic variances of 9 opt and <r opt respectively as 

P + a 2 v - Pcp v (2atu) 



AsVgopt(w) 
AsVs-o P t(u;) 



2Pou 2 tf(auj) 
P + al-2P V 2 {au) 



Pip^aoj) 



2P 



da 



(8) 



(9) 



B. Simplified Estimator 

From the structure of Zl in © and the characteristic function, ip n {auj), alternative estimators for 9 and 
a can be constructed. Separating the signal into its magnitude and phase components, 

\z L \ = VP(p v (au)), (10) 
Z.z L = u9, (11) 

where (flOT ) depends on a and not 9, whereas (fTTT) depends on 9 and not a, and can be used to construct low- 
complexity estimators. The simple estimates, 9 sim and cr sim , are the solutions to (TTTT) and (flOT ). respectively. 
In what follows, the relationship between these estimators and the minimum-variance joint estimator in 
© is established. 
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Theorem 1: When \z L \ < yP, the estimates 9 and a that solve (fTTT) and (ITOT ). respectively, are those 
that minimize ©, that is, 

e opt = § sim (12) 

<j opt = <r sim (13) 

Proof: The proof is presented in Appendix [A] ■ 
Since zl is asymptotically given by z = \/Pe ju ' e (p ri (auj) in ©, and because tp v (auj) < 1, the 
condition of Theorem [T] \zi\ < yP, is satisfied almost surely for sufficiently large L. Therefore, the 
estimators in (fT2l) and (fT3l are identical in the asymptotic regime, and they will be denoted by 9 and a. 
Their performance will also be the same, denoted by AsV§(co) and AsV^(cj) and given by ([8]) and ©, 
respectively. Recall that © and ® are in the diagonal of the asymptotic covariance matrix, indicating 
that the estimate of the location parameter and the estimate of the scale parameter are asymptotically 
independent. 

From the scale parameter and the location parameter of xi, the sensing SNR can be estimated as 

9 2 

7 = (14) 

The estimator of 7 in (fl4l) is constructed using the optimal estimators of 9 and a. Since the estimates 
of 9 and a are asymptotically ML, and the function in (fl4l) is one-to-one, it can be verified using the 
invariance property of the MLE [9, Thm. 7.2] that 7 is also an asymptotically ML estimate of 7. 

From the asymptotic variances of 9 and a and using [9, pp. 185], the estimate of 7 in (fT4l) has an 
asymptotic variance given by 

AsV^(u;) = AsV § (u) + AsV a (u) = ^ [As\ 6 (u) + -fAsV a (u)] , (15) 

where 7 := 9 2 /a 2 . 



C. Optimization of u 

Ideally, the sensors should use the value of to that minimizes the expressions in ([8]), © and (fT5l) . For 
many sensing distributions, it will be tractable to minimize AsVg(u;) and AsV#(u;) with respect to to. 
However, AsV^(a;) in (TT5T) will be more involved. We are therefore motivated to relate the minimizer, 
to*, of (TT3T ) with u* e and tu*, which minimize ([8]) and ©, respectively. Specifically, we will show that u* 
lies between uig and u*. To do this, we will exploit the fact that for many sensing noise distributions, the 
expressions for AsVg(w) and AsV^(w) are quasi-convex in to, and differentiable. A univariate function, 
f(cu) on w G (0, 2it/9r\, is quasi-convex if it satisfies any one of the following conditions [23, pp. 99]: 
(cl) f(co) is monotonic, i.e., f(u) is non-decreasing or f(u) is non-increasing 

(c2) f(u) has a global minimum at to* such that for to < to*, f(u) is non-increasing and for u > to*, 
f(u) is non-decreasing. 

For settings where AsV g(ui) and AsV#(u;) are quasi-convex in to, the following theorem provides a 
relationship between Ug, to* and to*. We will see later in this section that when the sensing noise is 
Gaussian, Laplace or Cauchy distributed, AsV q(uj) and AsV^(u;) satisfy either condition (cl) or condition 
(c2). 

Theorem 2: If AsVg(u) and AsV^(u;) are differentiable quasi-convex functions of u, then to* lies in 
between the values of Ug and u*. 

Proof: The proof is presented in Appendix |B] ■ 

In what follows, three sensing noise distributions, Gaussian, Laplace and Cauchy, are considered. In 
each case, (flOl ) and (fTTT) are applied to obtain the estimates, 9 and a, which are then used to construct 7. 
The performance of all three schemes are studied and ujg, u* a and to* are also determined. 
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1) Gaussian Distribution: The case of Gaussian distributed sensing noise is considered first. The 
characteristic function in this case is given by 

-uj 2 u 2 /2 



and the value of z is 



The estimators using (flOl) and (fTTT ) are given by 



9 



a 



-ZZT 



UJ 

1 

CO 



log 



p 



The asymptotic variances are calculated to be 

P + al - Pe 



2u) 2 a 



2„2 



AsV a (u) 



2Pu 2 e-^ 2 
P + al - 2Pe 



Pe 



-2u) 2 a 



2^2 



(16) 
(17) 

(18) 
(19) 

(20) 
(21) 



The value of u that minimizes the asymptotic variance of a will now be computed. Making the 
substitution <— cu 2 a 2 and differentiating with respect to 0, the following equation is required to be 
solved to find the stationary points of the asymptotic variance of a: 







i 



,2/3 



^ + 1) - 2, '-1 



0. 



(22) 



which depends on a, o 2 and P, but not on 9. It is straightforward to show that in the Gaussian case, 
d 2 AsV^(co)/dco 2 > 0. Therefore, the asymptotic variance is convex, and the solution to (|22l) leads to the 
unique minimum, u* = a/ 0°, pt /a, where 0° pt is the solution to (l22l) . Similarly, it can be shown that the 
asymptotic variance of 9 is convex. The value of to that minimizes the asymptotic variance is given by 

u* = Jff^/a, where 0° pt is the solution to 



a 



^ + i)(0-iye + (0 + i) 



0. 



(23) 



which depends on a, a 2 and P, but not on 9. Neither (|22l) nor (|23l can be solved analytically, but the 
solutions can be obtained numerically. 

The asymptotic variance of the SNR estimate is calculated using (fT5l) and is given by 



AsV^(u;) 



27- 



P + af 



2Pe 



-2u 2 a 2 



+ 7 



P + a 2 - 2Pe 



Pe 



-2ui 2 a 2 



PujWe-" 2 * 2 ' (24) 

Since AsVg(u;) and AsV^a;) are convex, from Theorem |2] cu* lies between the values of co* e and cu*. It 

jopt 



is easy to verify that co* = \J 0° p / a, where 0° pt is the solution to 





+7 



0<e 2f3 [^ + l 



0{e 



,26 



-e 2/3 










e 2/3 



2e' : 



0. 



(25) 
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2) Laplace Distribution: Let rji be drawn from a Laplace distribution of mean zero and variance a 2 . 
The characteristic function is ^ 



<p v {crco) 



1 + 



and the value of z is 



The estimators in this case are 



1 + ^ 



= ~^ZL, 



a 



V2 VP 



- 1, 



with the asymptotic variances of and a given by 

(^ + l)(l + 2 W V 2 )-l 



AsVafw) 



8w 2 (1 + 2u 2 a 2 ) (2 + wV 2 ) 



-2 • 



, ^(2 + ,rV) 2 + uV 2 (6 + wV) 

AsV^u;) = — 5 

32wV 2 (2 + wV 2 r 2 

Using (fT51) . the asymptotic variance of 7 is given by 

1 {2 + u 2 a 2 f 



AsV ^ ) = 8P^(l + 2c,% 2 ) 



Aa 2 u 2 {2Pu 2 a 2 + a 2 (l + 2wV) } 



+ 7 (1 + 2a; V) {PaV (6 + wV) + a 2 v (2 + wV) 1 
To minimize the asymptotic variance of it can be shown that Ug is given by cog = 



opt 



12 V ffi + 1 



+ 



and 



c J = 125 



P 



2\ 3 



2-")S ( 



07 



+ 141 



P 



3y/S\ 



P \P 



. a 



(26) 
(27) 

(28) 
(29) 



(30) 
(31) 



(32) 
Pe pt /cx, where 

(33) 



+ 1 ) ( 375-^ + 32 ) + 8. (34) 



To minimize the asymptotic variance of a, one needs to calculate to* = 

\[Wlo, where /3° pt is the 

solution to the quintic equation 



16 



P 



.err 



P 



.err 



P 



a 



+ 1 ] ^ + 2 I 12^ + 13 I /3 4 - I 7^ + 8 ) /3 a - 23^/3 2 - 9^/3 



err 



P 



P' P 



0. 



(35) 



Similarly, the asymptotic variance of 7 is minimized at lo* = J (3° pt jo, where /3° pt is the solution to 



p p 

+ 7 ( 7 7 ^ - 14^ - 87) /3 3 - (23 7 + 2) - 9 7 ^/3 - 7^ = 0. 



16 7 + 2 + 7 -£ + 2-£ /T + 2 M37 - 8 + 12 7 -^ - 



cr. 



.cr? 



P P 



(36) 
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The quintic equations in (1351 ) and (|36l) cannot be solved analytically. However, the solutions to these can 
be obtained numerically. It is straightforward to see that d 2 AsV §(u) / 'dui 2 > and d 2 AsV a- (uj)/ dui 2 > 0, 
and therefore, AsVg(cj) and AsV^(u>) are quasi-convex [|23l pp. 101]. Therefore, from Theorem |2] to* lies 
between oj* e and to*. 

3) Cauchy Distribution: Since the Cauchy distribution does not have any finite moments, the scale 
parameter in this case is selected to be the Cauchy parameter, a, which specifies the half-width at half- 
maximum (HWHM) [24]. The characteristic function is given by 

<Pt,{<tu) = e~ aul , co>0, (37) 

to yield 

z = \fPe^ 6 e~ ua (38) 

and the estimates of 9 and a are given as 

(39) 
(40) 

These estimators have the asymptotic variance given by 

p , 2 _ p -2wo 

AsV § (u) = AsVt(u) = 2 ; u2e _ 2 ^ ■ (41) 




The asymptotic variance of 7 can be calculated using (1151) and is given by 

Since the asymptotic variances of both 9 and o are identical, and can be shown to be quasi-convex, 
from Theorem |2] the same value of cu minimizes the asymptotic variances of all 9, b and 7. Taking the 
first derivative of the asymptotic variance with respect to cu and equating to zero, the value of u> that 
minimizes the asymptotic variances is given by 



2 + W 
CO* = 



2P 



e 2 (P+vl) 



(43) 



2a 

where W(-) is the Lambert-W^ function, which is the inverse function of xe x [|231 . 

IV. Per-Sensor Power Constraint 

In the case of per-sensor power constraint, the total transmit power increases as the number of sensors 
in the system increases, with the channel noise variance remaining the same. Each sensor transmits with 
a power of P and the signal at the FC, shown in © is given by 

L 

y L = y/pJ2e j " Xl + u. (44) 
1=1 

A. The Estimator 

At the FC, the signal from (1441 is modified to give 

a:=f = vp±£y-' + £, (45) 

i=l 



9 



which as L — > oo, converges with probability one to 



c 



lim ( L 

L— >oo 



- 1 L 

P lim - V , 

L-s-oo L 



(Pr,[CTiO) 



(46) 



Defining £ L = [(j* and £ = [£ R £ J ], £ L converges to £ in such a way that 

C = lim VZ(Cl ~ (47) 

is a 2 x 1 Gaussian random vector with zero mean and a 2 x 2 covariance matrix £ with elements 

Eii = P [v c cos 2 (uj9) + v s sin 2 (u;#)] 



S22 
E12 



P [v s cos 2 (cui 

S21 = m - 



) + w c sin 2 (w(9)] 
sinful) cos(u;6 



where the parameters v c : = var[cos(o;^)] = 1/2 + ip v (2atu)/2 — (p 2 (atu) and £ s : = 
<p v (2au)) /2. The minimum variance estimator for [0 a] T in this case is given by 



(7 



argmin[C L -C] J S [C L - C] 



and the asymptotic covariance matrix of the estimates is given by 
variances 

1 — ip n {2auj) 



AsVa w 



AsV^fo;) 



2a; 2 y2 2 (cra;) 

1 - 2y? 2 (o-u;) + ip v (2<ju) 



(48) 

var[sin(a;7#)] = 1/2 — 
(49) 

to yield the asymptotic 

(50) 
(51) 



which can be verified to be ([8]) and © with a v — > 0. 

The development in this per-sensor power constraint case shows that as the number of sensors increases, 
the effect of channel noise becomes negligible. In fact, the results in the case of per-sensor power constraint 
can be interpreted as a special case of the results in Section Unl with o 2 — > 0. These results are separately 
presented since closed form solutions can be obtained for cu* for the different sensing noise distributions 
considered. The estimate of the SNR is computed as given in (fl4)) . with asymptotic variance as given in 
(fT5l) . Theorem [fl Theorem |2] and the ML invariance property continue to hold. 

The three sensing noise distributions considered previously, the Gaussian distribution, the Laplace 
distribution and the Cauchy distribution are considered again for the per-sensor power constraint case. In 
each case, the performance is evaluated and the values of cu that minimize the asymptotic variances of 9, 
a and 7 are calculated. 

1 ) Gaussian Distribution: The performance in this case is given by substituting a v = in © and © 
to give 



-2^0- 



2^2 



AsVa(u) 



2 2 

1 - 6 



2wVe- 



(52) 
(53) 
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The asymptotic variance of 7 is given by 



7 (1 - 2e-^ 2 + e~ 2 ^ 2 ) + u 2 a 2 (l - e 
2u;W 



-2uJ 2 cr 2 



AsV» = n .. A _*L.™ " ~- (54) 



The value of to that minimizes the asymptotic variance of 9 is given by 

w e * = argmin 2 2 ■ (55) 

u 2u z e w CT 

It can easily be verified that the objective is minimized as cuq — > 0. In a similar way, it can be shown 
that cu* — > minimizes the asymptotic variance of a, and that AsV^fw) is also minimized when cu* — > 0. 
However, if to = 0, the transmissions from the sensors do not depend on the sensed data, invalidating 
the choice of to = 0. Therefore, in order to minimize the asymptotic variance, a sufficiently small value 
of u is selected at the sensors ll2i~l . The apparent discrepancy between the choice of cu suggested by 
the asymptotic analysis (small to) and its limiting value of to = is due to the asymptotic nature of 
our analysis. In Figure |51 we show that as to — > for small L, the value of AsVg(w) increases greatly, 
indicating poor performance, as expected. However, for large L, the minimum is for smaller values of to. 
We elaborate more on Figure |5] in Section [V] 

2) Laplace Distribution: The asymptotic variances are given by © and © with a v — > 0: 

A \7 ( \ tx 2 (2 + cV) 2 (5 + u,V 2 ) ^ 

MY ^ U) = 16(1 + 2^) • (57) 

The asymptotic variance of 7 is given by 

7 (2 + to 2 a 2 f [ 8u;V 2 + 7(l + 2a; V 2 ) (6 + to 2 a 2 )] 
8to 2 a 2 (1 + 2to 2 a 2 



AsV^u) = ' l o - 9/ /\ 9 9N ;v ^. (58) 



To identify the value of to that yields the best performance for estimating 9, the following problem 
needs to be solved: 

. a 2 (2 + to 2 a 2 ) 2 
c e = argmm 4(i + 2a;V2) . (59) 

By inspecting the first derivative, it can be verified that tog = 1/a. For the case of a 

. (2 + to 2 a 2 ) 2 (6 + to 2 a 2 ) 
to* a = argmin ^ ^ '- . (60) 



This is minimized at to* = (l/ay/8) y 3V33 — 13 > tOg. The value of to that minimizes AsV^(cj) is 
similarly calculated to be 



-137 - 16 + ^(97 + 16) (337 + 16) 
4(7^/7 



= 7-^= • (61) 



5) Cauchy Distribution: In the case of Cauchy distributed sensing noise, the asymptotic variances for 
the estimates, 9, a and 7, are given by 

1 — p- 2uJcr 

AsVjM = AsV,( W ) = ^ 2e _ w , (62) 
A.V*) = 27 fa^fe^ - (63) 
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Distribution 


Gaussian 


Laplace 


Cauchy 


s§ 


1 


0.66 


0.65 




1 


0.5 


0.65 



TABLE I 

Information Efficiency for 9 and <t different distributions. 



Since AsVg(cj) and AsV^u;) are identical, the value of to that minimizes them is the same. Therefore, 
the value of u that minimizes AsVg(w), AsV#(u;) and AsV^(u;) is given by 

uj* = ± '-. (64) 

B. Asymptotic Relative Efficiency 

Since a non-linear scheme is used to transmit the observations from the sensors to the FC, it is required 
to evaluate the loss of information due to this processing. To evaluate this loss, the asymptotic relative 
efficiency is defined for each of the estimators. 

In the case of estimating a, the asymptotic relative efficiency is defined as 

-i -l 



I a inf AsV^fcu) 

u>e(0,2ir/6 R ] 



(65) 



where l a is the Fisher information of the observations, Xj, about the parameter a [|26ll - [|28l , and AsV^cj) 
is the asymptotic variance of the estimator of a. It can be shown that I a depends only on o and not on 9, 
but £a is independent of both a and 9. The asymptotic relative efficiency depends only on the distribution 
of the sensing noise and < S a < 1. 

The second row of Table U shows the values of the asymptotic relative efficiency when estimating a for 
the Gaussian, Laplace and Cauchy distributions. The Fisher information is calculated using the definitions 
in ||26l - ||28l , for the different distributions, yielding 2cr~ 2 , a~ 2 and 0.5cr~ 2 for the Gaussian, Laplace 
and Cauchy distributions, respectively. The values of inf we ( ,27r/e fl ] AsV^(o;) are calculated using (1531 ) for 
the Gaussian distribution, (1571) for the Laplace distribution, and (|62|) for the Cauchy distribution. When 
estimating a, for the distributions considered in this paper (Gaussian, Laplace and Cauchy), the asymptotic 
relative efficiency is one only in the case when the sensing noise is Gaussian. 

Similarly, in the case of estimating 9, the asymptotic relative efficiency is defined as 



Si 



inf AsYa(u) 



(66) 



where Iq is the Fisher information of the observations, Xu about the parameter 9 Ii261 - ll28ll . and AsVg(w) 
is the asymptotic variance of the estimator of 9. It is well known that I e is independent of 9. The 
asymptotic relative efficiency for the estimators of 9 are recorded in the first row of Table I] The values 
of the Fisher information are given by cr~ 2 , 2a~ 2 and 0.5cr~ 2 for the Gaussian, Laplace and Cauchy 
distributions, respectively, and the values of inf we ( 27r /e fl ] AsVg(cu) are calculated using (|52l ), (|56l and 
(|62|) . respectively. 

It can be seen from these results that there is no loss in efficiency only in the case of the Gaussian 
distribution. It has been shown in [|29l that in the case of estimating 6, the asymptotic relative efficiency 
is one if and only if the noise distribution is Gaussian. In all other cases, information is lost due to the 
non-linear processing at the sensors. 

Note that these results do not indicate that Gaussian noise yields the best performance. It means that 
only in the case of Gaussian sensing noise, there is asymptotically no loss in information about 9 or 
a due to the transformation x — > e^ x . As an example, consider estimating 6, where {r]i} are Laplace 
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§ = 1; cr= 1; P= OdB; al = 1 Gaussian Sensing Noise 




Fig. 2. Asymptotic variance vs. scale parameter. Sensing noise is Gaussian distributed. The asymptotic variances match the CRLB. 



8 = 1; a = 1; P = OdB; a^ = l; Sensing noise Distribution - Laplace 




Fig. 3. Asymptotic variance vs. scale parameter. Sensing noise is Laplace distributed. The asymptotic variances match the CRLB. 

distributed. It can be shown that inf we ( ,27r/6i fl ] AsV^(u;) is smaller for the Laplace sensing noise compared 
to the Gaussian case [|29ll . 

V. Simulation Results 

Simulations are first carried out for the total power constraint case, and then for the per-sensor power 
constraint case. For the total power constraint case, in each case of sensing distribution, the estimators 
are simulated and compared. The values of the optimum to for each parameter are indicated on the graphs 
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= 1; £7 = 1; P = OdB; o\ = 1; Sesning Noise - Caucy Distribution 




Fig. 4. Asymptotic variance vs. scale parameter. Sensing noise is Cauchy distributed. The asymptotic variances match the CRLB. 




0.8 1 1 1 1 

0.005 0.01 0.015 0.02 



Fig. 5. Plot of ivariance(f9) vs. uj for different values of L. 

and compared with the theoretical values. In the case of per- sensor power constraint, the estimators are 
evaluated across different values of a. The performance measures are compared against the inverse of the 
Fisher Information, which is known to be the Cramer-Rao Lower Bound (CRLB), a lower bound on the 
variance of unbiased estimators. 

Figure |2] shows the performance of the estimators of 8, a and 7 versus u in the total power constraint 
case and Gaussian sensing noise. It can be seen from the plots that Uq < to* < to* as expected. The values 
of ujg, cu* and cu* are also calculated from (|23l ), d22) and (|25l ), respectively, and marked on the figure, 



14 



L = 500; ui = 0.01; 9 = 1 




0123456789 10 



Fig. 6. Asymptotic variance vs. to. Sensing noise is Gaussian distributed. Simulation values match numerical results 

verifying the results. 

The system with Laplace sensing noise is simulated and the results are shown in Figure |3] The estimators 
of 9, a and 7 are evaluated and the performance is plotted versus cu when the total power is constrained 
across the sensors. As expected from the results in Section HII-C2I cu$ < cu* < cu*. Using the formulas 
in d33l) . (f35l) and (l36l) . the values of tog, cu* and cu* are calculated and shown on Figure |3] where the 
theoretical and simulation values are seen to agree. 

Figure |4] shows the performance of the system when the sensing noise is Cauchy distributed for the 
total power constraint case. The values of AsVg(w), AsV^w) and AsV^(w) are plotted against cu. It is 
easily seen that AsVg(w) = AsV^(cu) and it is verified that cug = cu* = cu*. The theoretical value from 
(|43T) matches the value from the simulation. 

In the per-sensor power case, when the sensing noise is Gaussian distributed, it has been argued in 
Section IIV-A1I that the estimators are optimal if cu — > 0, while the sensed data are not sent to the sensors 
if u — 0. This discontinuity is demonstrated in Figure |5] It can be seen that for small L, as cu — > 0, the 
performance suffers. However, for a larger number of sensors, the asymptotic variance is minimized for 
smaller cu. 

In Figure |6l AsV§(uj) and AsV^u;) are plotted versus a when the sensing noise is Gaussian for the 
per-sensor power constraint case. The value of cu = 0.01 is used. When compared against the CRLB, in 
the case of Gaussian sensing noise, both the estimators are asymptotically efficient, since the asymptotic 
variances are the same as the respective values of the CRLB. 

In Figure [Vj the sensing noise is Laplace distributed. The performance of the estimators of 9, o and 7 are 
plotted against a for the per-sensor constraint case. For transmissions from these sensors, cu = cu* e = 1/a. 
In this case, the estimators are not asymptotically efficient as the asymptotic variances are larger than the 
CRLB. 

Cauchy distributed sensing noise was considered for the results shown in Figure [8] The estimators 
of both the location parameter and the scale parameter are plotted versus a for the per-sensor power 
constraint case. Here, cu = cu* = 0.7968/cr. Both estimators have the same performance. Additionally, 
both parameters have the same CRLB, which are lower than the asymptotic variances of the location 
parameter and the scale parameter. Therefore, in the case when the sensing noise is Cauchy distributed, 
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Fig. 7. Asymptotic variance and CRLB vs. scale parameter. Sensing noise is Laplace distributed. 




Fig. 8. Performance vs. a. Sensing noise is Cauchy distributed. 



the estimators are also not asymptotically efficient. 

VI. Conclusions 

A problem of simultaneous distributed estimation of the scale parameter and location parameter of 
a signal embedded in noise was considered for arbitrary sensing noise distributions. Sensors observe a 
parameter in sensing noise and transmit the observations using a constant-modulus phase modulation 
scheme. The sensors transmit the observations over a Gaussian multiple-access channel to a fusion center. 
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Due to the additive nature of the channel, the signal received at the FC converges to the characteristic 
function of the sensing noise distribution as the number of sensors grows large. The phase-modulation 
scheme presented is robust to impulsive sensing noise distributions and ensures a fixed transmit power 
irrespective of the signal or noise realization. Two cases of sensor power are considered, one with a total 
power constraint across all the sensors, and another imposing a per-sensor power constraint. 

At the fusion center, an estimation scheme is presented that is used to estimate the mean, variance, 
and SNR of the observations, by using only a single set of transmissions from the sensors. Estimators 
are used to estimate a location parameter, 9, and a scale parameter, a. For each case of sensing noise 
distribution, the optimum transmission parameter, to, was calculated. 

The estimates of the scale parameter and the location parameter were combined to construct an estimator 
for the SNR of the observations. It was shown that this was an asymptotically minimum- variance estimator. 
The performance of the SNR estimator was also evaluated. 

For each estimator, the value of to that minimized the asymptotic variance was determined. It was shown 
that when the asymptotic variances of the location parameter and the scale parameter were quasi-convex 
in u), the optimum value of to for the SNR estimator lies between the optimum values of to for the location 
parameter and the scale parameter. 

In the case of per-sensor power constraint, the asymptotic efficiency of the estimators was also evaluated. 
When the sensing noise distribution is Gaussian distributed, the estimators are shown to be asymptotically 
efficient. For the other sensing noise distributions considered in the paper, the estimators are not asymp- 
totically efficient, though they may have a better asymptotic variance than in the case of the Gaussian 
sensing noise. 



Appendix A 
Proof of Theorem Q] 

Using the values of z L and z and using £ from ©, the estimator in © can be simplified to 

1 T 



a 



opt 



Defining s(9) := z R cos(co9) + z 1 sm(cu 



argmin< \z L \ 2 [<p v (2croj) + 1] [l + P(pl(aoo) 

+ Prf(auj) [1 - (z?) 2 cos 2 (w0) - (z[) 2 sinV#) - z% z{ sin(2u;0)] 

- P(p 2 (au) [zf cos(u9) + z I L sm(u9)] 2 [<p n (2au) - <f 2 (auj)] 

— 2\fPip rj (auj) [z R cos(u9) + z{ sin(a;0)] [1 + (p v (2au)} 

the problem is rewritten first as 



^opt 



a 



opt 



r 



[GUO 



argmhJ \ Zl \ 2 [<^(2eru>) + 1] [l + P(fl 

8(0) L 

+ P<p 2 v (au) [1 - s 2 (6)] [1 + (pr,(2au)] 
- 2VPtp r) (aoj)s{e) [1 + (p v (2au)] }. 



(67) 



(68) 

Examining the first derivative of the objective function in (|68l ), we have that 9 solves (1681 ) if and only if 
it solves 



8(9) 



\zl\ 



The minimization problem in (1671 can now be reformulated as 

<r opt = argmin [1 + tp n (2au)] \z L \ — y/Pip^^au) 



cr>0 



(69) 



(70) 
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For large L, it can be seen from © that the effect of the channel noise is diminished, and with high 
probability, \z L \ < \/P. The objective function is minimized when \zl\ — \fP^r l { (y ^) = 0, which is 
identical to (flOi Substituting \zl\ — \fi 5l Pr l { (y u) in (1691) , the equation in (PTTI) is obtained, completing the 
proof. 

Appendix B 
Proof of Theorem [2] 

With AsV^,(w) = aAsY e (oj) + f3 AsV a- (ui), ol > and j3 > 0, it is required to prove Theorem |2] Three 
cases are considered: 

1) Both AsV§(u) and AsV a (to) satisfy condition (cl): When AsVg(w) and AsV^w) are monotonically 
non-decreasing, both will have their infima as to — > 0. AsV^(a;) will also be monotonically non-decreasing 
and will have its infimum as to — >■ 0. Similarly, when both AsVg(w) and AsV^w) are monotonically non- 
increasing, the minima of AsV§(u)), AsV^w) and AsV^fw) will lie at to = 2tt/6r. Finally, when one of 
the two functions is monotonically non-increasing, and the other is monotonically non-decreasing, ojg and 
lu* will be or 2ir/6 R . Since u* can lie only in [0, 2tc/8 r ], the proof is complete for this case. 

2) Both AsV e (u) and AsVa{oj) satisfy condition (c2): If Ug minimizes AsV§(u), AsV~(oJq) = 0, where 
AsV~(u)q) is the first derivative of AsVg(w) with respect to to, evaluated at ojg. Similarly if AsV^w) is 
minimized at u*, AsV~{u* a ) = 0. 

From (fT5T ), the expression for the asymptotic variance of 7 is given by 

AsV^(w) = aAsV e (co) + (3AsY a (u), (71) 

where a = AO 2 /a 4 > and (3 = 166 2 /a 6 > 0. If oj* is the minimizer of AsV^(cj), it is required to verify 
that 

AsVfa*) = 0. (72) 



The left-hand side of (1721) can be rewritten using (1711 so that the condition for cu* to be the minimizer of 

AsV^,(o;) is given by 



Asv^;) _ g 

AsV^w*) " a 



(73) 



The right hand side of (|73l) is negative. This happens only when one of the slopes of AsV e (cu) and 
AsV,j(u;) is positive and the other is negative. By using the quasi-convexity of AsV d (cu) and AsV^w), 
it can be seen that when the functions are quasi-convex, and when Ug < to*, the u axis can be divided 
into three regions: (i) u < uo* d , where both AsVg(w) and AsV,3-(a;) have negative slope; (ii) Ug < u < u*, 
where AsV^(a;) has a positive slope and AsV^(u;) has a negative slope; and (iii) u > lu*, where AsV e (cu) 
and AsV^(a;) both have positive slope [|23l pp. 99]. Therefore, the condition in (1731 is satisfied only when 
Ug < w* < u*. A similar argument can be made when ojg > u*. 

3) One of AsVgiu) and AsV&{uS) satisfies condition (cl) and the other satisfies condition (c2): Let 
AsVg(u) satisfy condition (cl) and let AsYs-(u) satisfy condition (c2). The condition in (1731 will need 
to hold in order to prove Theorem [2] If AsVg(w) is monotonically non-decreasing, ojg — > 0, and (1731 
is satisfied when to* < to*. When AsV e (uj) is monotonically non-increasing, ojg = 2tt/8r, and (|731 is 
satisfied when cu* > u*. A similar argument can be made when AsVg(o;) satisfies condition (c2) and 
AsV^(a;) satisfies condition (cl), completing the proof. 
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